The aftereffect of the ensemble average of facial expressions on subsequent facial expression recognition.

An ensemble or statistical summary can be extracted from facial expressions presented in different spatial locations simultaneously. However, how such complicated objects are represented in the mind is not clear. It is known that the aftereffect of facial expressions, in which prolonged viewing of facial expressions biases the perception of subsequent facial expressions of the same category, occurs only when a visual representation is formed. Using this methodology, we examined whether an ensemble can be represented with visualized information. Experiment 1 revealed that the presentation of multiple facial expressions biased the perception of subsequent facial expressions to less happy as much as the presentation of a single face did. Experiment 2 compared the presentation of faces comprising strong and weak intensities of emotional expressions with an individual face as the adaptation stimulus. The results indicated that the perceptual biases were found after the presentation of four faces and a strong single face, but not after the weak single face presentation. Experiment 3 employed angry expressions, a distinct category from the test expression used as an adaptation stimulus; no aftereffect was observed. Finally, Experiment 4 clearly demonstrated the perceptual bias with a higher number of faces. Altogether, these results indicate that an ensemble average extracted from multiple faces leads to the perceptual bias, and this effect is similar in terms of its properties to that of a single face. This supports the idea that an ensemble of faces is represented with visualized information as a single face.

Face identity and facial expression representations with adaptation paradigms: New directions for potential applications.

Adaptation and aftereffect are well-known procedures for exploring our neural representation of visual stimuli. It has been reported that they occur in face identity, facial expressions, and low-level visual features. This method has two primary advantages. One is to reveal the common or shared process of faces, that is, the overlapped or discrete representation of face identities or facial expressions. The other is to investigate the coding system or theory of face processing that underlies the ability to recognize faces. This study aims to organize recent research to guide the reader into the field of face adaptation and its aftereffect and to suggest possible future expansions in the use of this paradigm. To achieve this, we reviewed the behavioral short-term aftereffect studies on face identity (i.e., who it is) and facial expressions (i.e., what expressions such as happiness and anger are expressed), and summarized their findings about the neural representation of faces. First, we summarize the basic characteristics of face aftereffects compared to simple visual features to clarify that facial aftereffects occur at a different stage and are not inherited or combinations of low-level visual features. Next, we introduce the norm-based coding hypothesis, which is one of the theories used to represent face identity and facial expressions, and adaptation is a commonly used procedure to examine this. Subsequently, we reviewed studies that applied this paradigm to immature or impaired face recognition (i.e., children and individuals with autism spectrum disorder or prosopagnosia) and examined the relationships between their poor recognition performance and representations. Moreover, we reviewed studies dealing with the representation of non-presented faces and social signals conveyed via faces and discussed that the face adaptation paradigm is also appropriate for these types of examinations. Finally, we summarize the research conducted to date and propose a new direction for the face adaptation paradigm.

Cultural differences in food detection.

The ability to detect food plays an indispensable role in our survival and wellbeing. Previous psychological studies have revealed that food is detected more rapidly than non-food items. However, whether the detection of food could be modulated by cultural factors remains unknown. We investigated this issue in the present study using a visual search paradigm with Polish and Japanese participants. Photographs of international fast food, domestic Japanese food, or kitchen tools were presented alongside images of non-food distractors (cars). Participants were asked to judge whether the stimuli were all identical or not. The reaction time data showed that participants from both cultures detected food more rapidly than kitchen tools. Japanese participants detected fast food more rapidly than Japanese food, whereas Polish participants did not display such differences between food types. These results suggest that rapid detection of food is universal, but is modulated by cultural experiences.

Image database of Japanese food samples with nutrition information.

BACKGROUND: Visual processing of food plays an important role in controlling eating behaviors. Several studies have developed image databases of food to investigate visual food processing. However, few databases include non-Western foods and objective nutrition information on the foods. METHODS: We developed an image database of Japanese food samples that has detailed nutrition information, including calorie, carbohydrate, fat and protein contents. To validate the database, we presented the images, together with Western food images selected from an existing database and had Japanese participants rate their affective (valence, arousal, liking and wanting) and cognitive (naturalness, recognizability and familiarity) appraisals and estimates of nutrition. RESULTS: The results showed that all affective and cognitive appraisals (except arousal) of the Japanese food images were higher than those of Western food. Correlational analyses found positive associations between the objective nutrition information and subjective estimates of the nutrition information, and between the objective calorie/fat content and affective appraisals. CONCLUSIONS: These data suggest that by using our image database, researchers can investigate the visual processing of Japanese food and the relationships between objective nutrition information and the psychological/neural processing of food.

Facial EMG Correlates of Subjective Hedonic Responses During Food Consumption.

An exploration of physiological correlates of subjective hedonic responses while eating food has practical and theoretical significance. Previous psychophysiological studies have suggested that some physiological measures, including facial electromyography (EMG), may correspond to hedonic responses while viewing food images or drinking liquids. However, whether consuming solid food could produce such subjective-physiological concordance remains untested. To investigate this issue, we assessed participants' subjective ratings of liking, wanting, valence, and arousal while they consumed gel-type food stimuli of various flavors and textures. We additionally measured their physiological signals, including facial EMG from the corrugator supercilii. The results showed that liking, wanting, and valence ratings were negatively correlated with corrugator supercilii EMG activity. Only the liking rating maintained a negative association with corrugator supercilii activity when the other ratings were partialed out. These data suggest that the subjective hedonic experience, specifically the liking state, during food consumption can be objectively assessed using facial EMG signals and may be influenced by such somatic signals.

Cultural Moderation of Unconscious Hedonic Responses to Food.

Previous psychological studies have shown that images of food elicit hedonic responses, either consciously or unconsciously, and that participants' cultural experiences moderate conscious hedonic ratings of food. However, whether cultural factors moderate unconscious hedonic responses to food remains unknown. We investigated this issue in Polish and Japanese participants using the subliminal affective priming paradigm. Images of international fast food and domestic Japanese food were presented subliminally as prime stimuli. Participants rated their preferences for the subsequently presented target ideographs. Participants also rated their preferences for supraliminally presented food images. In the subliminal rating task, Polish participants showed higher preference ratings for fast food primes than for Japanese food primes, whereas Japanese participants showed comparable preference ratings across these two conditions. In the supraliminal rating task, both Polish and Japanese participants reported comparable preferences for fast and Japanese food stimuli. These results suggest that cultural experiences moderate unconscious hedonic responses to food, which may not be detected based on explicit ratings.

Hunger promotes the detection of high-fat food.

Efficient detection of food is important for an organism's survival. The results of previous experimental studies are consistent with this statement: food is detected in photographs faster than non-food items. Moreover, fat content modulates the speed of food detection. However, it is not known whether such sensitivity to the fat content of food is modulated by participants' internal states. To investigate these issues, we measured reaction times during a visual search task in which participants in fasting and postprandial states detected high-fat food (fast food), low-fat food (Japanese diet), and non-food (kitchen utensils) targets within crowds of non-food distractors (cars). Our results indicate that both hungry and satiated groups detected food targets more rapidly than non-food targets. The high-fat foods were detected more rapidly than low-fat foods in the hungry group, whereas no difference was observed between reaction times when satiated participants detected high-fat and low-fat food targets. These results suggest that food captures our visual attention even when we are satiated, and that fat detection efficiency is heightened when we are hungry.

Amygdala activation during unconscious visual processing of food.

Hedonic or emotional responses to food have important positive and negative effects on human life. Behavioral studies have shown that hedonic responses to food images are elicited rapidly, even in the absence of conscious awareness of food. Although a number of previous neuroimaging studies investigated neural activity during conscious processing of food images, the neural mechanisms underlying unconscious food processing remain unknown. To investigate this issue, we measured neural activity using functional magnetic resonance imaging while participants viewed food and mosaic images presented subliminally and supraliminally. Conjunction analyses revealed that the bilateral amygdala was more strongly activated in response to food images than to mosaic images under both subliminal and supraliminal conditions. Interaction analyses revealed that the broad bilateral posterior regions, peaking at the posterior fusiform gyrus, were particularly active when participants viewed food versus mosaic images under the supraliminal compared with the subliminal condition. Dynamic causal modeling analyses supported the model in which the subcortical visual pathway from the pulvinar to the amygdala was modulated by food under the subliminal condition; in contrast, the model in which both subcortical and cortical (connecting the primary visual cortex, fusiform gyrus, and the amygdala) visual pathways were modulated by food received the most support under the supraliminal condition. These results suggest the possibility that unconscious hedonic responses to food may exert an effect through amygdala activation via the subcortical visual pathway.

Facial Expressions of Basic Emotions in Japanese Laypeople.

Facial expressions that show emotion play an important role in human social interactions. In previous theoretical studies, researchers have suggested that there are universal, prototypical facial expressions specific to basic emotions. However, the results of some empirical studies that tested the production of emotional facial expressions based on particular scenarios only partially supported the theoretical predictions. In addition, all of the previous studies were conducted in Western cultures. We investigated Japanese laypeople (n = 65) to provide further empirical evidence regarding the production of emotional facial expressions. The participants produced facial expressions for six basic emotions (anger, disgust, fear, happiness, sadness, and surprise) in specific scenarios. Under the baseline condition, the participants imitated photographs of prototypical facial expressions. The produced facial expressions were automatically coded using FaceReader in terms of the intensities of emotions and facial action units. In contrast to the photograph condition, where all target emotions were shown clearly, the scenario condition elicited the target emotions clearly only for happy and surprised expressions. The photograph and scenario conditions yielded different profiles for the intensities of emotions and facial action units associated with all of the facial expressions tested. These results provide partial support for the theory of universal, prototypical facial expressions for basic emotions but suggest the possibility that the theory may need to be modified based on empirical evidence.

Hyper-realistic face masks: a new challenge in person identification.

We often identify people using face images. This is true in occupational settings such as passport control as well as in everyday social environments. Mapping between images and identities assumes that facial appearance is stable within certain bounds. For example, a person's apparent age, gender and ethnicity change slowly, if at all. It also assumes that deliberate changes beyond these bounds (i.e., disguises) would be easy to spot. Hyper-realistic face masks overturn these assumptions by allowing the wearer to look like an entirely different person. If unnoticed, these masks break the link between facial appearance and personal identity, with clear implications for applied face recognition. However, to date, no one has assessed the realism of these masks, or specified conditions under which they may be accepted as real faces. Herein, we examined incidental detection of unexpected but attended hyper-realistic masks in both photographic and live presentations. Experiment 1 (UK; n = 60) revealed no evidence for overt detection of hyper-realistic masks among real face photos, and little evidence of covert detection. Experiment 2 (Japan; n = 60) extended these findings to different masks, mask-wearers and participant pools. In Experiment 3 (UK and Japan; n = 407), passers-by failed to notice that a live confederate was wearing a hyper-realistic mask and showed limited evidence of covert detection, even at close viewing distance (5 vs. 20 m). Across all of these studies, viewers accepted hyper-realistic masks as real faces. Specific countermeasures will be required if detection rates are to be improved.

Cognitive adaptations for gathering-related navigation in humans.

Current research increasingly suggests that spatial cognition in humans is accomplished by many specialized mechanisms, each designed to solve a particular adaptive problem. A major adaptive problem for our hominin ancestors, particularly females, was the need to efficiently gather immobile foods which could vary greatly in quality, quantity, spatial location and temporal availability. We propose a cognitive model of a navigational gathering adaptation in humans and test its predictions in samples from the US and Japan. Our results are uniformly supportive: the human mind appears equipped with a navigational gathering adaptation that encodes the location of gatherable foods into spatial memory. This mechanism appears to be chronically active in women and activated under explicit motivation in men.